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Abstract 

This paper addresses Tikhonov like regularization methods with convex penalty function- 
als for solving nonlinear ill-posed operator equations formulated in Banach or, more general, 
topological spaces. We present an approach for proving convergence rates which combines 
advantages of approximate source conditions and variational inequalities. Precisely, our tech- 
nique provides both a wide range of convergence rates and the capability to handle general 
and not necessarily convex residual terms as well as nonsmooth operators. Initially formu- 
lated for topological spaces, the approach is extensively discussed for Banach and Hilbert 
space situations, showing that it generalizes some well-known convergence rates results. 

1 Introduction 

In recent years because of numerous applications which occurred in imaging, natural sciences, 
engineering, and mathematical finance a growing interest in different forms of regularization 
methods for solving nonlinear ill-posed inverse problems in a Banach space setting could be 
observed. This also led to new ideas for proving convergence rates of such methods in Banach 
spaces (see, e.g., [1,2,6-8,10, 13-22]). The main problem of handling ill-posed problems in 
Banach spaces is the absence of spectral theoretic tools including generalized source conditions 
with arbitrary index functions applied to the forward operator, which were essential for proving 
results in the Hilbert space setting. 

One way for obtaining convergence rates similar to the well-known Hilbert space results 
is the idea of so-called approximate source conditions, which was originally developed for lin- 
ear ill-posed problems in [9] (see also [3, 12]) and extended to nonlinear problems in Banach 
spaces in [8]. Approximate source conditions, however, rely heavily on the traditional residual 
structure being a p-th. power of the discrepancy norm. Therefore they are not suited for investi- 
gating convergence rates of variational regularization methods with general residual terms using 
appropriate similarity measures. Such progressive variants of variational regularization were 
suggested, comprehensively analyzed, and motivated by means of concrete examples in [17]. 

A second approach, which uses variational inequalities for proving convergence rates, was first 
formulated in [13] and has also been extended to general residual terms in [17]. The drawback 
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of this second approach in its original form is its limitation to the standard convergence rate 
0{6) for noise level 6 > when the reconstruction error is measured by a Bregman distance. 

In this paper, which is mainly based on the thesis [5], we present an alternative concept that 
allows both a wide range of different convergence rates and the use of general residual terms. 
Moreover, we give some new insight into the interplay of source conditions and variational 
inequalities by extending the ideas of [10] to a more general setting. Furthermore, we address 
the question concerning the role and admissible intervals of an exponent p > imposed on the 
residual term in Tikhonov type regularization (see also [11])- 

The paper is organized as follows: In Section [2] we introduce a Tikhonov type regularization 
method for the stable approximate solution of nonlinear ill-posed operator equations in topo- 
logical vector spaces with focus on Banach spaces. We formulate basic assumptions ensuring 
well-definedness, stability and convergence of the method and we give a short discussion on 
fundamental differences between the classical source conditions and variational inequalities. In 
Section [3] we extend the concept of variational inequalities introduced in [13]. Moreover, we for- 
mulate a first convergence rate result in that section. Based on Section [3] in Section HI which is 
the main section of this paper, we present the new approach of approximate variational inequal- 
ities for proving convergence rates of variational regularization methods with general residual 
term. In Section [5] we restrict our investigations to Banach spaces to clarify the interplay of 
approximate source conditions and approximate variational inequalities. The final Section [6] is 
devoted to some concluding remarks where also open questions are formulated. 



2 Problem, notation, and basic assumptions 

Let F : D{F) C [/ ^ y be an in general nonlinear operator possessing the domain D{F) and 
mapping between a real topological vector space U and a topological space V with topologies 
Tu and Ty. We are going to study operator equations 

F{u)=v^ (2.1) 

expressing inverse problems with exact data on the right-hand side. 

To ensure mathematical correctness some technical conditions on U and V (in particular the 
Hausdorff property) are required, but for the important case that U and V are Banach spaces 
these conditions are always fulfilled. The topologies tu und Ty should be regarded as "weak" 
topologies because as we will see later in Banach space settings they have to be weaker than the 
norm topologies. For this reason we denote convergence with respect to the topology tjj or Ty 
by 

Instead of the exact right-hand side in (j2.ip only noisy data for some noise level 5 > 
are available. To clarify the meaning of 6 we introduce a non- negative similarity functional 
5 : y X y — > [0, oo], which not necessarily has to have metric properties, and demand 

S{v\v^)<5 and S{v^,v^)<5. (2.2) 

As approximate solutions of (j2.ip we consider minimizers over D{F) of the Tikhonov type 
functional 

Tl{u) ■= S{F{u),v^)P + an{u) (2.3) 

with a stabilizing functional 17 : [/ — > [0, oo], a regularization parameter q > and a prescribed 
exponent < p < oo. We set 

D(Q) ■={ueU : n{u) < oo} and D := D{F) n D{n). 

Throughout this paper we make the following assumptions. 
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Assumption 2.1. 

(i) F : D{F) C [/ ^ F ist sequentially continuous with respect to tu and Ty, i.e. Uk ^ u 
with u,Uk € D{F) implies F{uk) F{u). 

(ii) D{F) is sequentially closed with respect to tu, i.e Uk ^ u with Uk G -D(F) and u & U 
implies u G F){F). 

(iii) There exists a u £ D with i*'(n) = u'^, in particular D 

(iv) The following assertions are fulfilled by S (with sequences {vk)ken and (■Ufc)^^^ in ^ and 

(a) S{v, ?;) = if and only \i v = v. 

(b) There exists a value s > 1 with 

S{vi,V2) < sS{vi,V'i) + sS{v^,V2) for all t'l , f 2 , € ^- (2-4) 

(c) 5 is sequentially lower semi-continuous with respect to ry, i.e. \i Vk ^ v and Vk ^ v 
then < liminffc^oo ^(ua,., Ufc). 

(d) S{vk,v) implies Vk v. 

(e) If S{vk,v) 0, 5(1^, Vfc) 0, and < cxo then S{v, Vk) S{v, v). 

(v) 17 is convex. 

(vi) is sequentially lower semi-continuous with respect to tjj, i.e. Uk ^ u implies Q{u) < 
limMk-^oo^iuk)- 

(vii) For each a > and each c > the level sets 

M„(c) Ti'('u) < c} (2.5) 

are sequentially pre-compact with respect to tu, i.e. each sequence {uk)keN in -Wq!(c) has 
a subsequence which converges with respect to tjj- 

In the sequel for simplicity we will use the terms "continuous" , "closed" , and so on instead 
of "sequentially continuous" , "sequentially closed" , and so on if no confusion is to be expected. 
By U* we denote the dual space of U, i.e. U* is the set of all r[/-continuous linear functionals 
on U. For E [/* and u (z U we write ^(u) if we evaluate the functional at the point u. If U 
is a Banach space, then we exploit the usual notation {£,,u)u*^u := £,{u). 

Example 2.2. Let U and V be Banach spaces and let tjj and ry be the corresponding weak 
topologies, i.e. 

Uk^u ^ {C,Uk)u*,u ^ {C,u)u',uyC(^U*. (2.6) 
Then the similarity functional 

S{vi,V2) := 11^1 - V2\\v (2.7) 

fulfills (iv) in Assumption 12.11 with s = 1. For a further discussion of this example see Section [5] 
below. 
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The next example, which is taken from [17], shows that next to norms also other similarity 
functionals are of interest. 



Example 2.3. Let {X, p) be a complete, separable metric space. By B{X) we denote the family 
of all Borel subsets of X, i.e. B{X) is the cr-algebra generated by the p-open sets in X, and by 
P{X) we denote the family of all Borel probability measures on X, i.e. P{X) is the family of 
all measures /i : B{X) —>■ [0, oo) satisfying n{X) = 1. For 1 < g < cxo we set 



F:=|//GP(X): j p(., 0)'^ d/x < ooj (2. 



and as topology Ty we choose the narrow topology on V, i.e. a series (/Ufc)fceN in ^ converges to 
fj, GV with respect to Ty if and only if 

fdfik^ [ fdfi (2.9) 
X Jx 

for all continuous and bounded real functions / defined on X. 

For defining the similarity functional S we introduce the set r(//i,//2) C P(X x X) (with 
Aii)/^2 G V) consisting of all measures n £ P{X x X) satisfying fi{{7ri)~^{A)) = fii{A) for all 
A £ B{X) and i = 1,2, where 7ri(a;i,a;2) := xi and 7r2(xi,X2) := a;2. Then the similarity 
functional S defined by 

5(/ii,//2) := f inf / p'' df)] , fll,^^2eV, (2.10) 



is a metric, the Wasserstein metric, on V and according to [17] it satisfies (iv) in Assumption [2TTJ 
This similarity functional has been applied to flow, mass transport, and image registration 
problems. For details on applications and some references we refer to [17]. 



In connection with the exponent p in ()2.3p from time to time we will make use of the 
inequality 

{a + by <Cp{aP + lf) (2.11) 

for a > and 6 > with 

fl ifO<p<l, , , 

Cp := < 1 2.12 

^ \2P"i ifp>l. ^ ' 

Under Assumption 12.11 one can show that there exist minimizers of the Tikhonov functional 
(j2.3|) for all p > and that these minimizers are stable with respect to perturbations of the data 
. The ideas of corresponding proofs given in Section 2 of [13] and in [17] can be applied to our 
general setting, and we note that hence existence and stability of minimizers can be ensured also 
in the case of exponents < p < 1 in Example 12.21 for which assertions are up to now missing 
in the literature. 

To formulate assertions about convergence of a series of minimizers as S tends to zero we 
need the concept of O-minimizing solutions: An element £ Z? is called ft-minimizing solution 
if 

F(u"f) = w° and n{u'') = mf{n{u) :ueD, F{u) = v^}. (2.13) 

Under Assumption 1 2 . 1 1 one can show that there exists an 0-minimizing solution. The following 
theorem was proven in [17]. 
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Theorem 2.4. Assume that Assumption \2.1\ is satisfied. Let {6k)k&, be a sequence in M mono- 
tonically decreasing to zero, let a : {0,Si] (0, oo) be a parameter choice with a{5) — > and 
■^^^ — > as (5 — > 0, and let Ok ■= ct{6k) and Vk ■= v^'' . Then every sequence {uk)keN in U with 
Uk G aj:gmm{S{F{u),Vky + Q!0(n) : u G D} has a Tij-convergent subsequence and the limit of 
each Tjj-convergent subsequence is an Q-minimizing solution. If the Q-minimizing solution is 
unique then (uk) converges to this Q-minimizing solution. 

To express convergence rates we use Bregman distances, which have become quite popular 
in recent years for this purpose. In this context, let 

u e Db := {u e U : dn{u) ^} and ^ dn{u) C U* , 

where dfl{u) denotes the subdifferential of 0, at u. Then the functional 

B(^{u,u) := i^{u) — Q{u) — ^{u — u), u € U, 

is called Bregman distance with respect to 0, u, and ^. In the sequel we always assume that 
there exists an f]-minimizing solution G Db- 

At the end of this section we want to mention the two basic concepts occurring in the 
literature for proving convergence rates of Tikhonov type regularization of ill-posed equations. 
Classical source conditions, as, e.g., in a Banach space setting ^ = F'{u^)*r], rj G V*, and in 
Hilbert spaces = 

i.e. sourcewise representations of an element ^ 
of the subdifferential of 0, for an J7-minimizing solution or of an fi-minimizing solution itself, 
are the main ingredient for proving convergence rates. Such classical kinds of source conditions 
express the smoothness of the solution with respect to the operator and they alone are responsible 
for possible convergence rates in linear ill-posed equation. If we are concerned with nonlinear 
operators F then in addition we have to take into account structural conditions which express 
the nonlinearity. For nonlinear ill-posed equations classical source conditions and nonlinearity 
conditions together control convergence rates. Their interplay, however, is rather complicated. 

Originally in [13] (see also [21]) an extended concept of source conditions was presented 
for obtaining convergence rates for the Banach space situation of Example 12.21 It is based on 
variational inequalities, which have to hold on appropriate level sets Ma{c) of the Tikhonov 
type functional ()2.3p . In [8,10] an additional exponent k G (0,1] was motivated such that the 
variational inequalities attain the form 

(e, - u)u*,u < l3iB^{u,u^) + (32\\F{u) - F{u^)\\^. (2.14) 

If such a variational inequality holds, then a convergence rate B^iu^f^^yU^) = 0(5^) as 5 ^ 
can immediately be derived without additional knowledge when appropriate a priori parameter 
choices are used. Both the classical source conditions and the structural conditions of nonlin- 
earity result into one parameter, namely the exponent k that alone controls the rate. 

3 Variational inequalities and convergence rates 

In this section we extend the concept of variational inequalities introduced in [13]. At first we 
state some simple properties of the level sets defined in (j2.5p . 

Proposition 3.1. Let be an ft-minimizing solution and let g > be an arbitrary constant. 
Then for < ai < a2 we have 
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(Hi) n Mc^iga) = {u £ D : F{u) = v^, n{u) < g}. 

Proof. Item (i) is trivial. Item (ii) follows from 

(n) = S{F{u),vy + aiQiu) - {ai - a2Mu) 

< gai — {ai — a2)^{u) = ga2 + (ai — a2){g — il(n)) < ga2 

for all u € Mai{gai) and (iii) from S{F{u),v^Y — '^(.6 ~ ^{u)) for all a > and for u G 

r\a>oMa(.ga). □ 

The next proposition shows the importance of the level sets Ma{ga). 
Proposition 3.2. Let u"^ be an 0,-mimmizing solution, a > 0, and 

g > CpsPO(iit). (3.1) 
Further let S h-> a{6) be an a priori parameter choice satisfying 

5P 

"('5) ^ 0, — — ^0 as 5 ^0 (3.2) 
a[o) 

and let u^^f^g^ G argmin{T^^^^ (n) : u € D} for 6 > 0. Then there exists a S > 0, such that 
^q((5) ^ Ma{ga) holds for all 6 G (0, 6]. 

Proof. Because a{6) and ^ as 5 — > there exists a 5 > with a{6) < a and 
< 2c^sP ~ ^^l{u^) for all 5 G {0,6]. For the sake of brevity we write a instead of a{6). For 
5 G (0,5] we now have (in analogy to [8, p. 5]) 

T^iui) < {sS{F{ui),v') + s6Y + an{ui) 

< CpsP{S{F{ui),v^r + aUiui) + (a - a)Q{ui) + dP) 

< CpsP(26P + aO(nt) + ^ {S{F{ui),v^f + an{ui)] 
= CpsP{5P + ^6P + an{u^)) < CpsPa{2^ + n{u^)) < ga. □ 

We now give the basic definition of a variational inequality in a stronger sense. 

Definition 3.3. An i7-minimizing solution satisfies a variational inequality, if there exist a 
^ G 5r2(M^) and constants g fulfilling inequality (j3.ip . a > 0, /3i G [0, 1), > 0, and k > 0, such 
that 

- ^{u - nt) < /5ii35(n, nt) + /325(F(u), F(nt))« (3.3) 
holds for all u G Ma{ga). 

As one would expect, a variational inequality with k = kq implies a variational inequality 
with K = Ki for each ki G (0,«;o)- The only changing constant in Definition 13.31 is the factor 
^2 = /32('^)- This follows immediately from 

P2{^o)S{F{u), F{u^)r = P2{'^o)S{F{u),F{u^)r-^^S{F{u),F{u^)r 

< P2{'^o){ga)'^S{F{u),F{u^)r 
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because u S Maiga) implies S{F{u), F{u^)y < ga. 

For K = 1 and for the case of topological spaces with general similarity functional S Def- 
inition [3]3] was introduced in [17]. The definition was already presented earlier in [13] for the 
Banach space situation with norm as similarity functional S. For that situation and k G (0, 1] 
this variational inequality (|3.3p appeared also in [8, proof of Theorem 3.3]. 

The connection between classical source conditions and variational inequalities will be dis- 
cussed in Section [5l 

We now give a first convergence rate result, which will be proven later in a more general 
context. 

Theorem 3.4. Let be an Q-minimizing solution which satisfies a variational inequality in 
the sense of Definition \3.3\ with < k < p and let 5 a{S) be an a priori parameter choice with 
cSP-i^ < a{5) < c5^~'^ for sufficiently small 5 and constants c > 0, c > 0. Then 

Bi{ui,syu^)=0{5^) as 5^^. (3.4) 



Note that the a priori parameter choice in Theorem 13.41 restricts the admissible values for 
the exponent k to the interval (0,p). As we will see this restriction is due to the proof technique 
using Young's inequality. On the other hand, the following proposition provides an upper bound 
for K in a variational inequality (|3.3p . A special case of this proposition was also formulated 
in [10, Proposition 4.3]. 

Proposition 3.5. Let be an Q-minimizing solution which satisfies a variational inequality 
in the sense of Definition \3.3[ If there exist a q > 0, a u € U with ^(u) < 0, and a to > 0, such 
that + tu ^ Ma{ga) holds for all t € [0, to], the limits 

n(u^ + tu) - n(u^) , 5(F(nt + tn),F(ut))9 
Ln ■■= lim , Ls := hm , 

t^+o t t^+o t 

i.e. the directional derivatives in in direction u of Q and S{F{*),F{v))Y , exist, and Lq = 
^(n) holds, then k < q must hold. 

Proof. Let k > q. For each t G (0, to] inequality (|3.3p then implies 

-C{tu) < Pi {n{u^ + tu) - niu^) - C{tu)) + /32S{F{u^ + tu),F{u^))'' 

and thus 



V V '^+0n 



Passage to the limit t — > -|-0 gives ^(n) > 0, which is a contradiction to S^{u) < 0. □ 

Remark 3.6. Under the standing assumptions of this paper on F, D{F), Q,, and one can 
easily show that for Banach spaces U and V and S{vi,V2) ■= \\vi — V2\\v the Proposition 13.51 
applies for q = 1 when F and O are Gateaux differentiable in . So in this case only variational 
inequalities ()2.14p with k < 1 can be satisfied if the singular case ^ = Q'{u^) = is excluded. 
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4 Approximate variational inequalities 

The aim of this section is to formulate convergence rates results without assuming that a varia- 
tional inequality is satisfied. As in the method of approximate source conditions (see [3] and [8]) 
we use distance functions d : [0, oo) — > [0, oo) measuring the violation of a prescribed benchmark 
condition. However, here we have a variational inequality (j3.3j) as benchmark condition and the 
distance functions are defined in a completely different manner. 

If a benchmark inequality of type (|3.3p is not satisfied then there exists at least one u € 
Maiga) with 

- nt) > l3iBi:{u,u^) + /325(F(n), 
Thus the "maximum violation" of a variational inequality (|3.3p may be expressed by 

sup {-au-u^)-f3iB^{u,u^)-(32S{F{u),F{u^)r). (4.1) 

The question whether the satisfaction of the benchmark inequality can be forced by increasing 
the factor P2 leads to the definition of an approximate variational inequality. 

Definition 4.1. An fi-minimizing solution satisfies an approximate variational inequality (ap- 
proximate inequality for short) if there exist a ^ € d^l{u^) and constants g fulfilling ()3.ip . q > 0, 
Pi G [0, 1), /32 > 0, 7 > and k > 0, such that the function d : [0, 00) — > M defined by 

d(r) := - min {^{u - u^) + f3iB^{u, u^) + p2r^SiF{u), F{u^))^) 

satisfies d{r) ^ as r — > 00. 

The constant 7 in Definition 14.11 seems to be not necessary, but it will turn out that it 
explicitly occurs in the formulation of convergence rates. 

At first we prove some basic properties of the distance function d. 

Proposition 4.2. Let be an Q- minimi zing solution which satisfies an approximate inequality 
in the sense of Definition \4-l\ Then we have: 

(i) < d{r) < 00 holds for all r > 0. 

(a) The minimum in the definition of d is attained. 

(Hi) d is continuous. 

(iv) d is monotonically decreasing. 

(v) If d{r) > holds for all r > 0, then d is strictly monotonically decreasing. 
Proof. 

(i) Because T^iv)) = m{u^) < ga we have G Ma{goi) and therefore d{r) > 0. For r > 

, _ 1 

from r2(?i) < g and S{F{u), F{u')) < {ga)p for u G Ma{ga) we get the estimate 

d{r) <C{r,n{u^)) + sup \^iu)\ (4.2) 

u£Ma{(>Ol) 

with a constant C < cxd depending on r and i7(u^) only. Assume there exists a sequence 
(ufc)fceN in Maiga) with |^(ufc)| 00. Then from Assumption 12.11 (vii) the existence of 
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a Tij-convergent subsequence (wfe,)igN follows; let u £ U be its limit. The continuity of ^ 
implies and therefore the boundedness of the sequence (|C(^^A;J|)- This 

contradicts |C('"fe)| oo- Thus 

sup \^iu)\ < oo, 
ueMaiea) 

i.e. d{r) < oo. 

(ii) We define 5^ : [/ ^ M U {+00} by 

gr{u) ■.= au-u^) + piB^{u,u^)+P2r^S{F{u),F{u^)r. (4.3) 

The continuity of ^ and F and the lower semi-continuity of CI and S together imply 
the lower semi-continuity of gr- Now let {uk)k&fi be a sequence in Ma{ga) satisfying 
Qriuk) inf„gj;^-(gfj) Qriu)- Then there exists a rf/-convergent subsequence {uk,)iefi with 
limit u G U, especially it holds u € AdaiQo:) (because is lower semi-continuous), and 

gr{u) < limini gr{uki) = lim gr{uki) = inf gr{u) 

holds. Thus, 5(r(u) = inf„eM^(£>£s) fi'r(^^)- 

(iii) For r > let gr be defined as in the proof of item (ii) and let Ur G Ma{Q(x) be a minimizer 
of gr- Then for all r, s > we have 

d{r) — d{s) = min^s — min^^ < P2{s'^ — r'^)S{F{ur), F{u'))'^ 

<gs{Ur) =gr{Ur) <{Qa)P 

and 

-(d(r) - d{s)) = min£, - min^, < ^2(r^ - s'') S{F{us),F{v})f , 

i.e. 

\d{r) - d{s)\ < P2{ea)^r'^ - (4.4) 

implying the continuity of d. 

(iv) The assertion follows directly from the definition of d. 

(v) If /32 = or 7 = would hold, then d would be constant. But this is not possible because 
d{r) > for all r > and d{r) — > as r ^ 00. Thus P2 > and 7 > hold. 

We assume that there is an r > for which gr (set as in the proof of (ii)) has a minimizer 
u G Ma{ga) satisfying F{u) = v^. Then for each s > we get 

= C{n - nt) + piI3i:{u, nt) + (32S^S{F{u), F{u^)r 

> min (^{u-u^) + piB^{u,u^)+(52S^S{F{u),F{u^))'^) 

= -d{s) 
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and thus d{s) ^ as s — > oo implies ^{u — u') + (3iB^{u,w) > 0. But this contradicts 

e(n-nt)+/3i^5(u,nt) 

= e(n - nt) + pil3i:{u, nt) + p2r''S{F{u), F{u^)r 

= min (C{u-u^)+f3il3.{u,u^)+(32r^S{F{u),F{u^))^) 

= -d{r) < 0. 

So for each r > each minimizer u € Ma{Qa) of satisfies the inequality S{F{u), F[u^)) > 

0. Now for < s < r we have 

(i(r) = - min gr{u) = -gr{u) 

= -9siu) - P2ir^ - s^) SiFiu) Fiu^)r 

>0 >0 
< -gsiu) < - min gs{u) = d{s), 

1. e. d ist strictly monotonically decreasing. □ 

Obviously an ri-minimizing solution satisfies a variational inequality in the sense of Defini- 
tion 13.31 if and only if it satisfies an approximate inequality in the sense of Definition 14.11 and 
there exists an > with (i(ro) = 0. 

If satifies an approximate inequality with constant a = then it satisfies an approximate 
inequality with a = ai for all ai G (0, ao] and with the same other constants. Later we will 
see that the constant a from Definition 14.11 does not appear explicitly in the formulation of 
convergence rates. So for the sake of plausibility of Definition 14. 1 1 the distance function d should 
be independent of a. The next two propositions give some insight into this problem. 

Proposition 4.3. Let he an Q,-minimizing solution which satisfies an approximate inequality 
in the sense of Definition \4. 1] Further let {rk)keN be a sequence in (0,oo) with r^ ^ oo and let 
(nfc)fcgi*} be a sequence of elements Uk € Ma{QOi) which realize the minimum in the definition of 
d, such that Uk ^ u holds for some ii £ D. Then it follows 

F{u) = v^, n{u)<Q, and ^{u - u'^) = j^{Q{u) - ^{u'^)). 

Proof. The definitions of and d{rk) imply 

-(32rlS{F{uk),F{u^)T = d{rk) + " + /^i^^K, u^). 

^Prom the continuity of ^ and the lower semi-continuity of for e > and suffiently large /c G N 
it follows 

-f32rlS{F{uk), F{u^)r > d{rk) + - u^) + piB^{u, u^) - e 

and therefore 

SiF{uk),F{u^)r < ^ (d(rfc) Hiu - nt) + (3,B^{i,, u^) - e) . 

Passage to the limit /c — > oo gives S{F{uk), F{u^))'^ and with Assumption 12.11 (iv)(d) this 
implies F{ujS) . On the other hand Assumption [2T] (i) implies F{uk) F{u) and therefore 
F{u) = v° holds. 
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The second assertion follows from 

il(n) < liminf O(nfc) < liminf i7^(ufc) < q. 

fc— >oo k-^oo 

To prove the third and last assertion we first observe 

-i{u-v))- l3iB^{u,v)) 

= _ ^t) _ p^B^(^u, u^) - l32rlS{F{u),F{v))Y 
< d{rk) ^ 0, 

which gives 

-i{u-v))- l3iB^{u,v)) <Q. (4.5) 

For e > and E N sufficiently large the continuity of ^ and the lower semicontinuity of 17 
imply 

> -P2rlS{F{uk),F{u^)Y = din) + i{uk - u^) + (3iB^{uk,u^) 
> d{rk) H{u - u^) + f3iB^iu, u^) - e. 

^0 

By passage to the limit A: — > oo we get i{u — v)) + PiB^{u, u^) < e and from the arbitrarity of e 
it follows 

-^{u-u^)-PiB^{u,u^)>0. (4.6) 
Inequalities (14. 5p and ()4.6p together imply 

-^{u-u^) = piBi:{u,u^) 

and substituting the Bregman distance by its definition gives the assertion. □ 

Proposition 4.4. Let be an VL-minimizing solution which satisfies an approximate inequality 
in the sense of Definition \4-l\ and let da for a S (0, a] he the function defined in analogy to d 
with a replaced by a. If there exists no u (z U with F{u) = , TZ{u) = g and ^{u — u^) = 
(g — r2(n^)) then the following assertions are true: 

(i) For all a G (0, a] there exists an r^ > 0, such that d{r) = da{r) holds for all r > ra- 

(a) For all a G (0,q;] there exists an ra > 0, such that for all r > ra all elements of Ma{ga) 
which realize the minimum in the definition of d{r) lie in Ma{QOi). 

Proof. Assertion (i) is a direct consequence of (ii). We give an indirect proof of assertion (ii). 
We assume that there exist an a € (0,q;] and a sequence {rk)kGN in (0, co) with — > oo, 
such that for each there exists an element Uk G Maiga) which realizes the minimum in the 
definition of (i(r^.) and which satisfies ^ Maigct). Because of Assumption 12.11 (vii) and the 
lower semi-continuity of the sequence {uk)keN has a convergent subsequence, which we again 
denote by {uk)keN^ with limit u G Ma{ga). 
Proposition 14.31 now implies 

F{u) = v°, n{u)<g and C{u - u^) = j^{^{u) - n{u^)). (4.7) 

/,From Uk ^ Ma{ga) in addition it follows 

n{uk) > g-^S{F{uk),vy 
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for all € N and thus S{F{uk), F{u^)) (c.f. proof of Proposition 14.30 implies ^{uk) > g — e 
for e > and sufficiently large k £ N. Together with 0,{uf:) < Q this gives ^{uk) — > g- Therefore 
from 

0>-(32rlS{F{uk),F{u^)r 
= d{rk) H{uk - ut) + /3i {VL{uk) - 0(ut) - i{uk - u^)) 
^0 

by passage to the limit we conclude 

G>{l-f3i)i{u-u^)+(3i{g-n{u^)) 
and together with ()4.7p we get 

^^{n{u) - ^{u^)) = e(n - ^t) < _|_(^ _ f^(^t)) 

i.e. especially it holds 7l{u) = g. Substituting this equality into (14. 7p gives a contradiction to 
the assumptions of the proposition. □ 

The following Lemma prepares the main theorem of this paper. 

Lemma 4.5. Let be an Q-minimizing solution which satisfies an approximate inequality in 
the sense of Definition \4-i\ with < n < p. Further let a a{5) be a parameter choice 
fulfilling the condition h3. 2\) from Proposition \3.S\ and let 6 be the corresponding constant from 
that proposition. Then there exist constants Ki > 0, K2 > 0, and > 0, such that 

< + K2a{6)^^r^^ + K^d{r) (4.8) 

holds for all r >0 and all 5 S (0, 6]. 

Proof. For the sake of brevity we write a instead of a{6). Proposition 13.21 and the definition of 
d{r) give us the inequality 

- C{ui - u^) < PiB^{ui,u^) + P2r"'S{F{ui),F{u^)r + d{r) (4.9) 

for sufficiently small 6. ^From this we get 

aB^{ui,u^) = S{F{ui),v^)P + aQ{ui) - af)(nt) - a^{ui - u^) - S{F{ui),v^)P 
<6P-aC{ui-u^)-S{Fiui),v'r 

<5P + aPiB(.{ui, u^) + aP2r^S{F{ui),F{v))Y + ad{r) - S{F{ui),v^Y 
<5P + a(3iB^{ui,u^) + a(32r^s''c^{S{F{ui),v^)'' + 5'') 
+ ad{r)-S{F{ui),v'r, 



where in analogy to Cp is given by 



1 ifO<K<l, 
2"-^ if K > 1. 
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Thus we have 

-S{F{ui),v^)P + ad{r)y (4.10) 

Now we apply the inequahty 

ab-eaP^< , (4.11) 

where a, 6 > 0, e > 0, pi,p2 > 1 and ^ + ^ = 1 have to hold, once with 

a:=5«, 6 := ac./32r^s", e := 1, Pi := ^, P2 := ^ 
and once with S{F{u^^),v^) instead of 6. We get 

S5(u^,nt) < (^2<5^^ + 2(c,/32s'^)f-«(^)p-«£^QP-rP- +ad(r) 

= 1431? + 2(c./32.'')— (^) ^ rP- + ^ d{r 



-■■Ki =:K2 =.K3 



Now we can prove the convergence rate theorem from Section [3l 



□ 



Proof of Theorem \3.4\ Because satisfies a variational inequality it also satisfies an approxi- 
mate inequality with a distance function d for which there exists an tq > with d{r) = for all 
r > tq. So the assertion follows immediately from Lemma 14.51 with r := rg. □ 

Theorem 4.6. Let be an Q,-minimizing solution which satisfies for some < k < p an 
approximate inequality in the sense of Definition \4.1\ with d{r) > for all r > 0. For r > we 
define 

p—K 'yp 1 -y 

^(^r) := d{r)~^r~~ and $(r) := d(r)~r~«. (4.12) 

Further let a ^ a{6) be a parameter choice with 5^ = a{6)d{^^^ {a{6))) for sufficiently small 
5 > 0. Then 

B^{ui^,yU^) = 0{d{^-\6))) asS^Q (4.13) 

holds. 

Proof. For the sake of brevity we write a{5) instead of a. Because d is strictly monotonically 
decreasing ^ and <I> are strictly monotonically decreasing, too. Thus the inverse functions ^'^^ 
and <I>~^ exist and are strictly monotonically decreasing. 
Lemma 14.51 with r := ^~^(a), i.e. 

implies 

B^{ui,u^)<Ki^-^ + {K2 + K:i)d{^!-\a)) = {Ki + K2 + Ks)d{^-\a)) 
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for sufficiently small 6 < 5 and from 

V ' 

we conclude ^~^(a) = ^~^{6), which proves the assertion. □ 

Remark 4.7. If instead of d only a strictly monotonically decreasing majorant d of d is available 
then Lemma 14.51 and Theorem 14.61 also hold with d replaced by d. 

The following propositions give some further insight into the convergence rates results of this 
paper. 

Proposition 4.8. With the notation of Theorem. \4.6\ it holds 

d{^-\6)) = o{5'') as 5^0. (4.14) 
Proof. With r := i.e. 6 = <&(?"), we have 

^(rY d(r)r^^ i 



d{^-\5)) d{r) d{r) 

^From 7 > and ^^^{5) ^ cxd as (5 ^ we conclude (^^"^{5)^^ Q as 5 Q and therefore the 
assertion follows. □ 

Proposition 4.9. With the notation of Theorem \4-6\ 

d{r) = 0{d{r)) as r ^ oo (4.16) 

implies 

d{^-\5)) = 0{d{^-\5))) as 5^0, (4.17) 
where ^ is defined in the same way as $ with d replaced by d. 

Proof. ^From d{r) = 0{d{r)) as r — s- oo it follows $(r) = 0{^{r)) as r — > oo and this implies 
d($-i((5)) = 0{^-^{6)) as 5 ^ 0. With r := <^-^{6), i.e. 6 = $(r), for sufficiently smah 6>0 
and a constant c > we get 



□ 



Proposition 13.51 told us that under weak assumptions there is an upper bound g > for k 
in a variational inequality. Now the question arises, whether there is also an upper bound for 
K in an approximate inequality. The next proposition does not answer this specific question, 
but it shows that the maximal rate which can be obtained with the approach of approximate 
inequalities as described in this paper is bounded by 5'^. 
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Proposition 4.10. Let the assumptions of Proposition [37S\ be satisfied, but let satisfy an 
approximate inequality in the sense of Definition \4- 1\ with d{r) > for all r > 0. Then, with the 
notation of Theorem \4-6[ 

6'' = 0{^-\5)) as 5^0 

holds. 

Proof. Assume that the assertion is not true, i.e. 

•S^^O .sS^O (4,18) 

holds. As in the proof of Propostion l3.5t but starting with the inequahty 

-^{u - nt) < piBi:{u, nt) + p2r^ S {F (u) , F {u^ + d{r) 
for u e Ala^ga) and r > instead of (|3.3|) . for t G (0, to] and r > we get 

^ „ ' ^ „ ' 

Now we choose r[t) := $ (ti), i.e. we have t = ^{r{t))i. On the one hand this (together with 
(gH])) imphes 

d{r{t)) d{^-\t-^)) 



t 

and on the other hand this imphes 



as t ^ +0 



rjtr^rit))- djrjt)) 

r(t) 'ti = = >0 as t ^ +0. 

^ ^ t t 

So all terms of the above inequality tend to zero as t ^ +0 and thus ^(n) > holds, which is a 
contradiction to the assumption ^(n) < 0. □ 

The role of 7 in an approximate inequality is not completely clear at the moment. If we 
assume that a distance function d has a majorant d of the form d{r) = ar~^"' with a > and 
6 > then the auxiliary functions in Theorem 14.61 become 

\I/(r) = air ^ and $(r) = a2r ^ (4.19) 

with constants 01,02 > and thus the theorem provides the convergence rate 

Bd<iS),^^) = 0{d^^), (4.20) 

which is independent of 7. This example shows that at least in some cases the constant 7 plays 
no role. In the proof of the next proposition, however, we will see that distance functions with 
majorants d{r) = ar"^'' may occur. Furthermore, sufficient conditions for the occurrence of 
some 7 > in that context can also be found in Lemma |5.4[ 

If an fi-minimizing solution satisfies a variational inequality, then Theorem 13.41 gives us the 
corresponding convergence rate. Now an interesting question is whether in this case also an 
approximate inequality with higher k is satisfied and, if so, does Theorem 14.61 provide the some 
rates as Theorem 13. 4P The next proposition answers this question. 
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Proposition 4.11. Let be an Q-minimizing solution which satisfies a variational inequality 
in the sense of Definition \3.3\ with < k < p and let fi € {k,p) be such that does not satisfy 
a variational inequality with k replaced by ji. Then v) satisfies an approximate inequality in the 
sense of Definition ]^-- 1\ with k replaced by fi and the rates obtained from the variational inequality 
with K and from the approximate inequality with /i coincide. 

Proof. Let g, a, /3i, and /32 be the constants from the variational inequahty satisfied by u^; let 
7 > be arbitrary. For all u € Maiga) and all r > then 

- C{u - nt) - PiB^iu, u^) - l32r^S{F{u), F(ut))M 

< /325(F(n), F(nt))- - p^r'' S {F (u) , Fiu^)r 

follows and 

ab-EaP^< ^, (4.21) 
for a,b > 0, e > 0, pi,p2 > I and ^ + ^ = 1 with 

a:= {l32r^S{F{u),F{u^)Yy, b := r'"^ , 



e := 1, pi := -, p2 



K — K 



implies 



d(r)< max (-^{u - u^) - piB.{u,u^) - P2r^SiF{u), F{u^)Y) 

i.e. satisfies an approximate inequality and the corresponding distance function d has a 
majorant d of the form d{r) = ar~^ with a > and b = 
Equation (j4.20p with k, replaced by p, thus gives 

M<i5) , = = = 0{5'') (4.22) 

for the parameter choice a{5) = cS^~'^^ = c5^ 'i^^ = c6p~'^ with a constant c > 0. This is 
exactly the convergence rate which is stated by Theorem 13.41 □ 



5 Source conditions and variational inequalities 

An important question which remains to be answered is the interplay of approximate source 
conditions and approximate inequalities. Note that we discussed the relationships between 
classical source conditions and variational inequalities in the last paragraph of Section [2] (see 
also [10]). 

At first we want to show that the concept of approximate variational inequalities described in 
this paper is a generalization of the concept of approximate source conditions in Banach spaces 
as introduced in [8] . So in this section our focus is on the situation of Example 12.21 and we let U 
and V be reflexive Banach spaces with tu and Ty describing the corresponding weak topologies. 
We set 5(^1, ^2) := \\vi — V2\\v for vi,V2 G V, i.e. we are concerned with the Tikhonov functional 

T^{u) = \\F{u) -v^fy + an{u) (5.1) 
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with < 5. In Example 12.21 we mentioned that item (iv) of Assumption 12 . 1 1 is satisfied 

with s = 1. We moreover assume that F, D{F) and are chosen such that the other items of 
Assumption 12.11 are satisfied, too. 

For the remaining part of this section let S Db be an J7-minimizing solution. Because 
pre-compact subsets of reflexive Banach spaces are bounded for all a there is a constant > 0, 
such that 

\\u - u^\u < Ka for all u G Maiga) (5.2) 

holds. 

We make the following additional assumptions. 
Assumption 5.1. It holds: 

(i) D{F) is starlike with respect to , i.e. for all u € D{F) there is a to > 0, such that 
nt + t{u - nt) G D(F) holds for all t G [0, to]- 

(ii) There is a bounded linear operator F'{u^) : U —>■ V, such that 



F(^t + t(^-nt))-F(nt) , , 
r [u^ )[u — ) 



^0 as t ^ +0 

V 



holds for all n G D. 



The convexity of 0, and Assumption 15.11 (i) imply that D is then also starlike with respect 
to In the sequel we denote by F'[u^)* : V* ^ U* the adjoined operator of F'{u^), where U* 
and V* are the dual spaces of U and V with respect to the norm topologies. The handling of 
weakly continuous linear functionals becomes much simpler by the fact that a linear functional 
on a Banach space is weakly continuous if and only if it is continuous with respect to the norm 
topology. 

We now define what we understand under source conditions. 

Definition 5.2. The ri-minimizing solution li^ satisfies a source condition if there exists an 
element ^ G d^l{u^) with ^ G TZ{F'(u^)*). The fi-minimizing solution satisfies an approximate 
source condition if there exists an element ^ G dQ{u^) with ^ G Tl{F' (u^)*) and we define the 
corresponding distance function d : [0, oo) [0, oo) by 

d{r) := min{|[^ — F'{u^)*ri\\u* : rj G V*, \\r]\\v* < 

As mentioned in [8] the distance function d is well-defined, non-negative, finite and monoton- 
ically decreasing. If satisfies a source condition, then it obviously also satisfies an approximate 
source condition and there is an ro > with d{r) = for all r > r^. If satisfies an approximate 
source condition with ^ G TZ{F'{u'^)*) \ TZ{F' [v))*) then d{r) > holds for all r > and d is 
strictly monotonically decreasing. 

The following definition was used in [8] and [10]. 

Definition 5.3. Let ci,C2 > 0. The operator F is said to be nonlinear of degree (ci,C2) with 
respect to 17, and ^ G dQ.{u^) if there exist constants g fulfilling (|3.ip . a > 0, and i^T > 0, 
such that 



\\F{u) - F{u^) - F'{u^){u - u^)\\v < K\\F{u) - F{u^)\\^^Bi:{u,u^) 
holds for all u G Ma{ga). 



C2 



17 



The following lemma is an adaption of results in [8] . 

Lemma 5.4. Let the ^-minimizing solution satisfy an approximate source condition and let 
F be nonlinear of degree (ci, C2) with respect to Q,, w^, and ^ with ci G (0, 1 — C2] and C2 € [0, 1). 
Further let k := and ro > 0. Then there exist constants Pi G [0, 1), P2 > 0, and 7 > 0, 
such that 

-{C,u- u%*,u < PiB^{u,u^) + P2r^\\F{u) - F{u^)\\^ + Kj{r) 
holds for all u G Ma{Qa) and all r > ro. It holds (3i = C2 and 7 = jz^- 

Proof. For r > let r/j. G V* be an element for which the minimum in the definition of d{r) is 
attained. Then for u G Ma{ga) we have 

-{C,u- u')u*,u 

< I {F'{u^)*7]r + e - F'{u^)*7]r,U - ,u\ 

= I {r]r, F'{v)){u - u^))v'y + - F'{u^Yrir,u - u%,,u\ 




u — u ^) + F{v)) - F{u)\\v + Kj{r) 
< Kr\\F{u) - F{u^)\\'^B^iu,u^y'' + r\\F{u) - F{u^)\\v + Kad{r). 

Now we have to distinguish between two cases: 

• Case C2 = 0. We get 

< Kr\\Fiu) - Fiu^)]]"^ + r\\F{u) - F{u^)\\v + Kj{r) 

= {Kr + r\\F{u)~Fiu^)\\\r''-^)\\F{u)-F{u^W^+KJir) 

<{K + {Qa)^)r\\F{u) - F{u^)\\'^ + Kj{r). 

• Case C2 G (0, 1). We apply the inequality 

ah < 1 for a,b>0, 1 = 1, pi,P2 > 1 

Pi P2 Pi P2 

with 

a := B^iu,u^r\ b := Kr\\F{u) - F(«t)||ci^ ,= 1^ ,= ^_ 

" C2 \-C2 
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and get 

-{^u- v))u\u 

< Kr\\F{u) - F{u^)\\''^B^{u,u^y^ +r\\F{u) - F{u^)\\v + K^d{r) 

< C2B^{u,u^) + (1 - C2)K^-2r^-2 \\F{u) - F{u^)\\y^^ 
+ r\\F{u)-F{u^)\\v+Kj{r) 

= C2B^{u, u'') + Kad{r) 

+ ((1 - C2)K~r~ + r\\F{u) - F(n^)||v'"'' ) ll^(^^) - F{u^)\\lr^ 
<C2Bf{u,v)) + Kj{r) 

+ ((1 - C2)K—2 + rY^^y—^WFiu) - F{v))\\^\ □ 

Theorem 5.5. Let the Q-minimizing solution satisfy an approximate source condition and 
let F be nonlinear of degree (ci,C2) with respect to $7, and ^ with ci G (0, 1 — 02], C2 G [0, 1), 
0'''^d 1^7^ < P- Then satisfies an approximate inequality in the sense of Definition \4-l\ with 
< K = < p and 

d{r) < Kad{r) for all r > r^ > 
with ro from Lemma \5.4\ holds. 

Proof. The assertion is a direct consequence of Lemma 15.41 □ 

If satisfies a source condition then by Theorem [53] also satisfies a variational inequality 
and Theorem 13.41 and [8, Theorem 3.3] provide the same convergence rate. In analogy we have: 
If satisfies an approximate source condition then also satisfies an approximate inequality 
and the rates obtained in Theorem 14.61 are not worse than the rates in [8, Theorem 4.3]. 

Remark 5.6. In [13] and [8] it has been shown that in the case ci = and C2 = 1 a source 
condition ^ = F'{u^)*rj with < 1 implies a variational inequality with k = 1. The 

converse result that a variational inequality with k = 1 implies the source condition is true if F 
and Q are Gateaux differentiable in (see [21]). However, the authors think that convergence 
results in the case ci = and C2 = 1 are missing when only satisfies an approximate source 
condition in the sense of Definition 15.21 with d{r) > for all r > 0. 

Now that we know about a basic relationship between approximate source conditions and 
variational inequalities we conclude this section by repeating from [10] the interplay of classical 
Holder type source conditions and variational inequalities in Hilbert spaces. So let U and V 
be Hilbert spaces and let F = ^ be a bounded linear operator. Taking the standard Tikhonov 
functional 

T^{u) = ||^'u-t;^||^ + a||u||^ 

the subdifferential of = || • ||^ at n G [/ is the singleton {{•,2u)i/} (where {',')u denotes 
the inner product), i.e. we set ^ = {•,2u^)u, and the corresponding Bregman distance is 
B^{',u^) = II* — u^lfj. To legitimize the extended concept of variational inequalities for k ^ 1 
in [10] the following is stated: 

If satisfies a source condition of type G Tl{{A*A)2) with fj, G (0, 1) then satisfies a 
variational inequality 

{u^ - u,2u^)u < Pi\\u - u^\l + P2\\Aiu - u^)\\^ (5.3) 
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with K = For fi = 1 this holds too, as we saw in the Banach space setting above. Because 
of Proposition 13.51 such a relationship cannot hold for > 1. In [10, Proposition 5.7] also the 
following converse result is formulated: If satifies a variational inequality ()5.3p with exponent 
K then it satisfies a source condition of type G Tl{{A*A)^) for all /i G (0, 2^)- 



6 Conclusions and open questions 

The following diagram should help to understand the cross-connections between the different 
approaches for obtaining convergence rates. In this context, =^ stands for an implication and 
— > stands for "as good or better as". This, however, is only a very rough characterization of the 
interplay which the reader can find in detail in the corresponding theorems, propositions and 
remarks. 



rates 

: 

rates 



source 
condition 

variational 
inequality 



approximate 
source condition 

approximate 
variational 
inequality 



rates 

T 

rates 



As we have seen from Proposition l3.5l Remark l3.6l and Proposition l4.10] for the Banach space 
setting when (12.70 and ()5.ip are under consideration the proven convergence rates of Section [3] 
and Section U] are because of the occurring limitation k < 1 by construction not faster than 
•^f (^a(<5)' ~ ^i^) as (5 ^ 0. Therefore with the technique of variational inequalities (|2.14p 
and also with the corresponding approximate inequalities we are captured in the low rate world. 
A higher rate world for that Banach space setting was structured, for example, by the recent 
papers [7, 16], where under higher source conditions, for p > 1, and provided that the space V 
is smooth enoug h rates up to B^{uf^^g^,u^) = 0{6^/^) can be proven. 

In our low rate world the rates are additionally limited by the inequality k < p. Up to now 
the literature considered preferably the case p > 1, where this inequality gives no restriction. In 
the case < p < 1, however, for which our approach also applies, this gives a serious restriction. 
One can interpret the condition k < p then as follows: The exponent < p < 1 seems to be a 
qualification of the chosen method (similar to the qualification of linear regularization methods, 
see [4]) which itself defines an upper bound for convergence rates. If the smoothness of the 
solution grows further, i.e. p < k < 1, then the convergence rate does not follow. Note that 
the boundary situation < k = p < 1 shows the so-called exact penalization effect studied in [2] 
for p = 1, where the rate B^{u^^^,u^) = 0{6) was proven under the source condition ^ = F'{u^)*r] 
whenever the regularization parameter > was chosen fixed but small enough. ^From the 
proof of Lemma 14.51 yielding the estimate (j4.10p we immediately obtain the corresponding rate 
B^{u^^^,u^) = 0{5P) whenever a variational inequality is satisfied with exponent < p = k < 1 
and the regularization parameter a^x > is fixed and small enough. However, it is an open 
problem to answer the question whether the rates 0(6'^^^^'^'^^) for < p < 1 can be improved 
or not. 

An advantage of our new approach for the low rate world is the fact that the items (ii) and 
(iii) of Proposition 13.11 tell us that {Ma{Qa) : a > 0} in some sense is a family of neighbourhoods 
of solutions to the equation F{u) = v^. We recall that if a variational inequality holds on 
a level set Ma{ga) then it holds on each level set Maiga) with < a < a. Hence, satisfying 
a variational inequality means that there exists an arbitrarily small neighbourhood of such 



20 



that a variational inequality holds on this neighbourhood. Or, in other words, convergence rates 
depend only on the behaviour of the three functionals — u^), B^{*,u^) and S{F{'), F{u^)) 
in an arbitrarily small neighborhood of the set of solutions. Looking at the problem from such 
functional point of view this suggests the conjecture that some kind of variational inequality 
like tools may exist, which is able to integrate higher source conditions and would lead us to 
the higher rate world. For example, we see that <S and F themselves are not important, only 
their combination S{F{'), F{u^)) is of interest. Hence one could ask in this context how the 
mentioned functionals reflect the combination of source conditions and structure of nonlinearity 
in case of higher smoothness. This should be forthcoming work. 
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